Markov processes with product-form stationary distribution
نویسندگان
چکیده
This research has been inspired by several papers on processes with inert drift [5, 6, 4, 3, 1]. The model involves a “particle” X and an “inert drift” L, neither of which is a Markov process by itself, but the vector process (X, L) is Markov. It turns out that for a number of diffusions with inert drift, the stationary measure has the product form; see [1]. The purpose of this note is to characterize processes with product form stationary distributions. This seems to be a difficult task for the family of all Markov processes so we limit ourselves to finite state spaces. These processes are simple on the technical side so we can analyze them in a quite explicit way. In particular, we obtain a number of examples that can generate conjectures for diffusions with inert drift.
منابع مشابه
Markov network processes with product form stationary distributions
This study concerns the equilibrium behavior of a general class of Markov network processes that includes a variety of queueing networks and networks with interacting components or populations. The focus is on determining when these processes have product form stationary distributions. The approach is to relate the marginal distributions of the process to the stationary distributions of “node t...
متن کاملA. Economou: a Characterization of Product -form Stationary Distributions
We consider a general model for continuous-time Markov chains representing queueing systems in random environment. First we study the relationship between its equilibrium distribution and the Palm (or embedded) distributions at certain environmental change epochs. The results enable one to obtain the equilibrium distribution of the continuous-time model in terms of the equilibrium distribution ...
متن کاملProduct-Form Poisson-Like Distributions and Complex Balanced Reaction Systems
Stochastic reaction networks are dynamical models of biochemical reaction systems and form a particular class of continuous-time Markov chains on N. Here we provide a fundamental characterisation that connects structural properties of a network to its dynamical features. Specifically, we define the notion of ‘stochastically complex balanced systems’ in terms of the network’s stationary distribu...
متن کاملMatrices with banded inverses: Inversion algorithms and factorization of Gauss-Markov processes
The paper considers the inversion of full matrices whose inverses are -banded. We derive a nested inversion algorithm for such matrices. Applied to a tridiagonal matrix, the algorithm provides its explicit inverse as an element-wise product (Hadamard product) of three matrices. When related to Gauss–Markov random processes (GMrp), this result provides a closed-form factored expression for the c...
متن کاملLocal Stabilization of Non-Ergodic Jackson Networks with Unreliable Nodes
This thesis contributes to a better understanding of the behavior of queueing networksthat cannot approach a classical equilibrium state.We consider Jackson networks with unreliable nodes which randomly break down andare under repair for a random time. Our networks are described by Markov processesthe states of which incorporate the availability status and the queue-lengths vect...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007